Novel Neuronal Activation Functions for Feedforward Neural Networks
نویسندگان
چکیده
منابع مشابه
Sensitivity Analysis for Feedforward Artiicial Neural Networks with Diierentiable Activation Functions
A method for computing the network output sensitivities with respect to variations in the inputs for multilayer feedforward artiicial neural networks with diierentiable activation functions is presented. It is applied to obtain expressions for the rst and second order sensitivities. An example is introduced along with a discussion to illustrate how the sensitivities are calculated and to show h...
متن کاملA New Training Method for Feedforward Neural Networks Based on Geometric Contraction Property of Activation Functions
We propose a new training method for a feedforward neural network having the activation functions with the geometric contraction property. The method consists of constructing a new functional that is less nonlinear in comparison with the classical functional by removing the nonlinearity of the activation functions from the output layer. We validate this new method by a series of experiments tha...
متن کاملCorruption of Generalizing Signals in Densely Connected Feedforward Neural Networks with Hyperbolic Tangent Activation Functions
This paper discusses the propagation of signals in generic densely connected multilayered feedforward neural networks. It is concluded that the dense connecting combined with the hyperbolic tangent activation functions of the neurons may cause a highly random, spurious generalization, that decreases the overall performance and reliability of a neural network and can be mistaken with overfitting...
متن کاملHandwritten Digit Recognition Using Multi-Layer Feedforward Neural Networks with Periodic and Monotonic Activation Functions
The problem of handwritten digit recognition is tackled by multi-layer feedforward neural networks with different types of neuronal activation functions. Three types of activation functions are adopted in the network, namely, the traditional sigmoid function, the sinusoidal function and a periodic function that can be considered as a combination of the first two functions. To speed up the learn...
متن کاملGeneralization ability of Boolean functions implemented in feedforward neural networks
We introduce a measure for the complexity of Boolean functions that is highly correlated with the generalization ability that could be obtained when the functions are implemented on feedforward neural networks. The measure, based on the calculation of the number of neighbour examples that differ in their output value, can be simple computed from the definition of the functions, independently of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Processing Letters
سال: 2008
ISSN: 1370-4621,1573-773X
DOI: 10.1007/s11063-008-9082-0